Method for determining the output of an assay with a mobile device

ABSTRACT

A testing apparatus for performing an assay, the testing apparatus comprising: a receptacle ( 2 ) containing a reagent, the reagent being reactive to an applied test sample by developing a colour or pattern variation; a portable device ( 1 ), e.g. a mobile phone or a laptop, comprising a processor and an image capture device ( 3 ), wherein the processor is configured to process data captured by the image capture device and output a test result for the applied test sample.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.13/980,300, filed on Feb. 24, 2014 and titled “Testing Apparatus,” whichwas a national stage application of Patent Cooperation TreatyApplication Serial No. PCT/GB14/051877, filed Jun. 19, 2014, titled“Testing Apparatus,” which claimed priority under 35 U.S.C. § 119 toUnited Kingdom Patent Application Serial No. 1105474.9, filed on Mar.31, 2011, the disclosure of each of the foregoing applications arehereby incorporated by reference.

The present invention relates to performing testing using a mobiledevice, such as a mobile phone. In particular, but not exclusively, theinvention relates to capturing and processing assay test data using amobile phone.

An assay, such as a bioassay or immunoassay, is a procedure in molecularbiology for testing or measuring the activity of a drug or biochemicalin an organism or organic sample. Chemical, biochemical, andmicrobiological assays based on the development of a colour change orvariation in colour hue within a defined area of a usually solidsubstrate are well known in a number of fields including industrial,clinical, environmental, and microbiological analysis.

Two common examples of such tests are pH indicator papers and homepregnancy tests. Typically, a colour change or the appearance of afeature on the test is assessed visually by the operator of the testusing the naked eye. In the case of a pH indicator the colour change isjudged by comparison to a reference scale often located on the containerof the tests. In the case of a home pregnancy test, the presence orabsence of a coloured line at a known location on the test stripindicates the result of the test.

These general concepts are widely applied in simple, fast, easy to use,and low cost point of use tests as well as laboratory based tests.However variations in the visual acuity of the operator can make itdifficult to obtain precise results, particularly when the result isclose to the limit of detection or where it must be matched to a slidingscale of hue to quantify the results. The precision, accuracy,reproducibility and repeatability of such tests can be compromised tothe extent that only qualitative or semi-quantitative results arepossible from such tests. Even where qualitative test results areacceptable, there is typically no formal record that the test took placefor quality or evidential purposes.

It is desirable to provide testing apparatus which does not rely on thevisual acuity of the operator. It is desirable to provide testingapparatus which provides quantitative rather than only qualitative testresults.

It is known to use an electro-optic instrument into which the test isplaced to be electronically interrogated. However, such instrumentationis often complex and custom designed for the specific application andaccordingly incurs significant hardware, firmware, and softwaredevelopment costs. The resulting apparatus is also often relativelybulky and therefore of limited portability.

It is desirable to provide testing apparatus which is readily available,portable and/or applicable to a plurality of different tests.

Many common consumer electronic devices, such as mobile phones, can beused to capture and process images, and to output or store the imagedata or share the image data via a network, such as a Wi-Fi ortelecommunications network. Processing of the image data is performed bythe device using a number of processing techniques to produce images ofgood quality. There is often a trade off in the techniques employed. Theprocessing is not configured to output only an image with the mostrealistic colour representation.

According to the present invention there is provided testing apparatusfor performing an assay, the testing apparatus comprising:

-   -   a receptacle containing a reagent, the reagent being reactive to        an applied test sample by developing a colour or pattern        variation;    -   a portable device comprising a processor and an image capture        device,    -   wherein the processor is configured to process data captured by        the image capture device and output a test result for the        applied test sample.

The portable device may comprise a mobile phone, PDA, digital camera,laptop or the like. The image capture device may comprise a camera.

The testing apparatus may be configured for performing an immunoassay,such as a lateral flow immunoassay. The testing apparatus may beconfigured for the detection of Legionella bacteria.

The reagent may be solid. Alternatively, the reagent may be liquid.

The testing apparatus may be operable to transmit one or both of thedata and the test result via a network.

The processor may be configured to measure the developed colour orpattern variation. Alternatively, the testing apparatus may include aremote processing device, such as a central computer, for measuring thedeveloped colour or pattern variation and calculating the test result.The portable device may be configured to transmit the data to the remoteprocessing device, and receive and output the calculated test result.

The remote processing device may be adapted to store one or both of thedata and the test result. The remote processing device may be adapted tostore one or both of the data and the test result from a plurality ofassays or portable devices.

The portable device or the remote processing device may be configured toprocess the data and the test result from a plurality of assays orportable devices to calculate one or more group values or parameters,such as an average, a standard deviation value, a trend function or thelike. The processor may be adapted to output the group value orparameter.

The portable device may be configured to modify the image to optimisethe colour representation of the image.

The portable device may be configured to apply correction and/orfiltering to an image to remove electronic or optical noise from theimage. The portable device may be configured to discard irrelevantportions of the image to reduce processing time. The processor may beconfigured to reject images which are of inadequate quality.

The portable device may be configured to control one or more of thebrightness, contrast, gain, colour balance and flash settings of thedevice during capture to achieve an optimal image for subsequentprocessing. The processor may be adapted to apply corrections tobrightness, contrast, sharpness and colour balance after imageacquisition.

The processor may be adapted to convert a colour image to a grey scaleimage or to a black and white image.

The portable device may be configured to compare two images and outputthe test result at least partially based upon the comparison.

The portable device may be configured to capture a plurality of images,each using a different exposure setting. The portable device may beconfigured to combine the plurality of images.

The processor may be adapted to correct the image for any rotationalmisalignment or skew.

The processor may be adapted to determine a degree of error associatedwith any rotational misalignment or skew for correcting the image.

The degree of error may be determined by comparing image features with aknown geometry of the receptacle. Alternatively or in addition, theportable device may include one or more orientation sensors, such asaccelerometers, and the degree of error is determined based on thesignal from the orientation sensors.

The testing apparatus may be configured to prevent image capture whenthe degree of error is greater than a predetermined value. The testingapparatus may be configured to prevent image capture when the signalfrom the orientation sensors corresponds to an orientation which isoutwith a predetermined range or value.

The processor may be adapted to summate one or more values of pixels inan identified region of interest.

The processor may be adapted to identify the positions of test lines.The processor may be adapted to perform peak searching within the regionof interest.

The processor may be adapted to quantify the size of test or controllines using a peak height or peak area. The quantified size may be usedto determine a measurement of concentration for the test. The processormay be adapted to determine a control peak. A test peak may bedetermined using a comparison with the control peak.

The portable device may be configured to transmit and/or storeassociated data along with the data. The associated data may compriseone or more of: a date or time of image capture; geolocation data forthe performed assay; image capture device settings; reagent data; anduser generated data.

The reagent data may comprise one or more of: a batch number; anexpiration date; and calibration information. The reagent data may beprovided on the receptacle. The reagent data may be presented in theform of packaging or a label. The reagent data may be provided in theform of written information which is readable by the portable device.The portable device may be adapted to interpret the written informationusing optical character recognition or the like. Alternatively, thereagent data may in the form of a one or two dimensional bar code.

The user generated data may comprise spreadsheet or database data, imageor sound files, typed or written text or the like.

The portable device may be adapted to display instructions or guidanceto the user for performing the test and/or interpreting the test result.The portable device may be adapted to provide substantially real timefeedback to the user during image capture. The feedback may relate toone or more of the position, orientation, and settings used. Theportable device may be configured to automatically capture the image.

The displayed instructions or guidance may comprise pre-processingsteps, incubation times and the like. The portable device may include acountdown-timer for timing test durations.

The portable device may be configured to read the reagent data, such asan incubation time. The portable device may be configured to only allowthe user to capture the image after testing once the incubation time haselapsed.

The portable device may be configured to display a guide or templateoverlay showing the outline of the reagent and/or one or more regions ofinterest. The feedback may be in the form of: a change of appearance,such as colour, of the guide or template overlay; or an audio or tactileindication that an image has been acquired.

The processor may be configured to utilise contrasting colours ordistinct objects to process data captured by the image capture deviceand output the test result. The contrasting colours or distinct objectsmay be provided by the receptacle.

Embodiments of the present invention will now be described, by way ofexample only, with reference to the accompanying drawings in which:

FIG. 1 is a perspective view of a testing apparatus according to theinvention;

FIG. 2 is a view of (a) a sandwich assay and (b) a competitive assay;

FIG. 3 is a view of an assay with (a) one control line and one testline, (b) a test line but no control line, (c) a plurality of test linesand one control line all on a single test strip, (d) a plurality of testlines and control lines on separate test strips mounted within a commonhousing;

FIG. 4 is a view of an assay with assays (a) presented in “dipstick”format, (b) where the test strip protrudes beyond the housing in onedirection, (c) contained within a housing, assays contained within ahousing where some or all of the housing is coloured to enhance thecontrast of the image when processed, and where markings are included ona housing to facilitate image processing;

FIG. 5 is a representation of an image (20) of a test (2) captured witha portable electronic device highlighting the region of interest (21)the result window (22) and the test (4) and control line (18);

FIG. 6 shows example formats of colorimetric tests where either adistinct region (24) or the entire immersed area (23) changes colour andis compared to a reference scale (25);

FIG. 7 is a schematic showing a possible receptacle configuration wherethe reference information (26) is printed on the test housing;

FIG. 8 shows a schematic of the signal intensity profile across alateral flow test indicating the peak height (27) and peak area (28)measurements to the baseline (29);

FIG. 9 shows schematic representations of example test strip andpackaging configurations: (a) cross section through a typical lateralflow immunoassay (34); (b) a colorimetric test with a single region ofinterest; (c) a colorimetric test with multiple regions of interest; (d)and (e) examples of test packaging with comparison scales; and

FIG. 10 shows an example of an image (37) being collected where both thetest receptacle (32) and the reference scale information (25) are heldin the same image.

FIG. 1 shows a testing apparatus for performing an assay. The testingapparatus comprises a receptacle containing a reagent in the form of atest strip, and a portable device in the form of a mobile phone [1]which has a processor and an image capture device or camera [3].

The mobile phone [1] can be used to capture and process images thenshare the resulting data via a telecommunications networks such as theinternet. It is therefore possible to avoid the requirement for aspecialist, custom designed piece of hardware and use a readilyavailable small portable mobile consumer electronic device such as themobile phone [1] to record and quantify the results obtained on teststrip style chemical, and immunoassay devices [2].

Furthermore the device has the ability to store the time, geo-location(e.g. GPS coordinates), and any other information obtained from theextended functionality of the device [1] and associated peripherals inaddition to any data captured visually (with the camera [3]), orally (asa sound file) or via typed or written notes. Such information may bestored on the device [1] for later retrieval, sent automatically or atthe users request to a laboratory information management system (LIMS),or other centralised database.

In addition to measuring the test response [4], the image capturefunctionality of the device [1] may be used to capture and process otherinformation about the test [2], such as batch numbers, expiration dates,or even calibration information presented on the test itself or e.g. thetest packaging or labels [5]. Such information may be provided in theform of written information (interpreted via optical characterrecognition) or in the form of standard or modified one or twodimensional bar codes.

This invention differs from known methods in that it uses only theinbuilt hardware of the device [1] requiring no external hardware ormodifications to the electronics or infrastructure of the device [1]. Akey development is the inclusion of the image processing on the device[1], enabling the device [1] to be operated stand alone without internetor phone connection if desired and also for “real time” feedback to theuser on the position, orientation, and image quality so that theoperator can quickly capture an image of adequate quality, before anywindow of opportunity for a valid test result may have elapsed.Processing directly on the device enables the maximum image quality tobe used. “Pre-filters” can be applied to discard irrelevant portions ofthe image such that processing time is minimised.

Where the dynamic range of the resulting image is inadequate for thelimit of detection, or where the constraints on lighting mean exposuresettings force the dynamic range to be too poor it may be desirable tocapture multiple images at different exposure settings and then combinethese into a single higher dynamic range ‘virtual’ image, usingappropriate algorithms to reorient the images between frames, and todiscard unwanted or low value data.

The functionality of the device [1] can also be used to display adviceor guidance to the user based on the results of the test, either from astored knowledgebase on the device [1] or by directing the user toappropriate internet resources.

Additionally the data may be processed to observe trends or patterns inthe measurements.

The image processing software on the device is provided as what iscommonly described as an “App”. Ancillary software can be integratedwith the image processing to facilitate the use, record keeping, orstorage of the results. Results from colorimetric assays can bequantified and/or recording using the mobile phone [1] simply byproviding the image processing software.

Similar principles may be applied to a number of different assayformats. They are described below in two broad groups, (1) assays wherethe sample flows over the test forming a colour change in a specificlocalised region of the test [2] and (2) assays where the colour change[24] is not localised, and it is then compared to a reference chart orscale [25].

Application to Lateral Flow Assays

Lateral Flow Assays, and their fabrication are well known to thoseskilled in the art. Assays are available commercially for a huge rangeof substances from small chemical species to microbiologicalcontaminants. The principles, fabrication and operation of such deviceshas been described in detail previously. The technology is applicable toany assay based on the interaction of a ligand with an analyte resultingin temporary or permanent change of colour, shade or hue with a specificspatial region of a test, resulting from flow along the length of a teststrip driven by capillary action. The detection method may be based oninteractions involving, an antibody, an antigen, a hapten, a protein, apolynucleotide (including but not restricted to DNA and RNA), a cell, acell fragment, a bacterium, a spore, a virus, a prion or a virion.

The use of a camera equipped mobile phone [1] to quantify the resultsfrom such assays is applicable to a broad range of lateral flow assaysincluding but not restricted to:

-   -   both sandwich assays [6] and competitive assays [7];    -   assays with one control line and one test line [8], assays with        a test line but no control line [9], assays with a plurality of        test lines and one control line all on a single test strip [10],        assays with a plurality of test lines and control lines on        separate test strips mounted within a common housing [11];    -   assays using coloured particles as the ligand label [12];    -   assays using metallic nanoparticles as the coloured label [12],        assays using nanoparticles in the size range 1-1000 nm, assays        using nanoparticles in the size range 2-100 nm, assays using        nanoparticles in the size range 10-80 nm, assays using metallic        nanoparticles comprising substantially one or more elements        displaying localised surface plasmon resonance such elements        include: copper, silver, aluminium, gold, platinum, palladium,        chromium, niobium, rhodium, and iridium;    -   assays using coloured polymeric particles as the ligand label        [12], assays where the polymeric particles are composed mainly        of latex, assays where the polymeric particles are composed        mainly of polystyrene, assays where the polymeric particles are        composed mainly of a polyolefin, assays where the polymeric        particles are composed mainly of nylon;    -   assays where the colour is formed directly or indirectly by the        interaction of a an enzyme with a substrate;    -   assays where the coloured ligand label [12] is substantially of        one of the following colours: red, blue, yellow, black, or        combinations thereof;    -   assays presented in “dipstick” format (i.e. with no plastic        housing [13], or where the test strip protrudes beyond the        housing in one direction [14]), assays contained within a        housing [2], assays contained within a housing where the housing        is formed primarily from plastic, assays contained within a        housing where the housing is substantially made from cardboard        or paper, assays where part or all of the housing is made from a        transparent material through which the result must be viewed;    -   assays contained within a housing where some or all of the        housing is coloured [15] to enhance the contrast of the image        when subsequently processed, assays where markings [16] are        included on a housing to facilitate image processing;

Following addition of a sample to a lateral flow assay, and the testbeing allowed to develop for a predetermined time the test willtypically form one or more discrete lines [17] perpendicular to thedirection of capillary flow along the test. Other patterns such as spotsare also used on some tests. Most lateral flow assays in commercial useconsist of at least one test line [4] and one control line [18]. Howeverthe invention is sufficiently adaptable that it can be modified to othershapes or format of assay.

The optical density (or colour intensity) of the test line [4] isrelated to the level of analyte [19] in the sample. In a sandwich assaythe optical density may be linearly proportional to the concentration ofanalyte over a certain range. In a competitive assay the optical densitymay be inversely proportional to the analyte concentration.

The optical density, or some other measurement of colour intensity maybe made using an image captured on readily available cameras [3], suchas those found integrated into mobile phones, tablet PCs, netbooks,laptop computers and other consumer electronic devices [1]. The image[20] may be processed by software included within the device [1]. Theexact steps and sequence of steps necessary to analyse an image [20]from a particular test may vary, but in general are likely to includesome, or all of the following:

-   -   (1) identify the location and orientation [21] of the test        strip/housing [2] in the image [20].    -   (2) identify the location of the result region [22] within the        test strip/housing.    -   (3) identify the presence/absence of the control line [18].    -   (4) identify the expected location of the test line [4].    -   (5) identify the magnitude of the test line [4] if any.    -   (6) compare the magnitude of the test line [4] to the magnitude        of the control line [18], or some other reference point, to        calculate the test result on a real or arbitrary scale.

The software may then store, display or distribute this data using otherfunctions and connectivity built into the consumer device. The softwaremay append time stamps, user identities, geographic locations or otheruser defined information to the data for future analysis and qualitycontrol.

The software may upload data to a central database such as a LaboratoryInformation Management System or other data repository. The software, ordatabase may be used to trigger certain actions, such as responding to aproblem identified by an individual measurement or trend, alerting auser or other interested parties to a result or trend or providingcontent (via the web, email, or other communication systems includingoff-line communication) relevant to the test results obtained. Thetargeted information could include marketing, advertising or promotionalmaterial, either now or at some future date based on the outcome ofresults.

The software may integrate with other services on the device or via theinternet such as calendars to provide reminders of regular test patternsas required.

The software may apply correction or filters to an image to removeelectronic or optical noise from the image. Many standard noise filtersare known to those skilled in the art. Simple noise filters may simplyinvolve convoluting two arrays.

The software may control the brightness, contrast, gain, colour balanceand flash settings of the device during capture in order to achieve anoptimal image for subsequent processing. The software may capture a “nonoptimal” image and apply corrections to brightness, contrast, sharpnessand colour balance after image acquisition.

The software may discard areas of the image which do not contain usefuldata to facilitate faster processing on the device.

The software may convert a colour image, to a grey scale image, or tosome other form of representation to facilitate faster processing on thedevice.

The software may convert some or all of the image to a black and whiteimage (binary array) to accelerate processing, for example indetermining the location and edges of the region of interest [22].Having identified the relevant portions of the image and calculated anynecessary rotational correction the software may then revert to some orall of the original image file, for more detailed processing.

The software may automatically reject images which are of inadequatequality to yield useful results.

The software may guide the user during image capture to assist the userin capturing a suitable image, e.g. correctly orienting the device,correctly focussing the device, and obtaining adequate illumination. Onepossible solution to simplify the processing, being to display a guideor template overlay showing the outline of the test strip and/or regionof interest (or simply a rectangle of the correct proportions). If theimage can be processed for suitability in near real time then thecorrect orientation may be indicated on the screen and image captureinitiated automatically. One option for this interactive feedback beingthe change of colour of the template, overlay or guide marks, forexample by changing from red (no suitable image) to green (suitableimage), thus avoiding additional ‘clutter’ in the display. Similarly,the software may provide the user with an audio or tactile indicationthat an image has been acquired, e.g. by playing a simulated “camerashutter sound”, a simple beep or activating an inbuilt vibration alertwithin the device.

The software may also provide the user with information about the useand operation of the test, e.g. pre-processing steps, incubation times,etc. The software may even force the user to allow the full incubationtime by taking images before and after testing.

The software may include a countdown-timer, for timing test durations.

Contrasting colours, e.g. on the test strip housing, and distinct shapesof housing may simplify the image processing. Where there is no housingor the housing is a similar colour to the test strip it may bepreferable to place the test strip against a contrasting backgroundduring image capture.

The software may capture information about for example the form or teststrip being used, its expiry date or batch-to-batch variation insensitivity from text based data printed on the strip or packaging, froma one or two-dimensional bar code (26) on the device or from some formof printed reference colour on the strip. Such data may be stored withthe eventual test results. Similar processes may be used to identifyphysical locations (e.g. with bar code tagged assets) or patients ortest users to accelerate and reduce data entry errors. Bar code captureeither taking place simultaneously with the test strip image capture orimmediately before or after.

The test strip or housing may be located on the image by scanning fromtop to bottom and left to right for an object of approximately the rightproportions. The proportions of the test strip or housing will normallybe well defined and highly repeatable, and thus preloaded on the device.Features or patterns on the housing or test strip can then be used toverify the recognition.

The scale of the image can then be estimated by comparing the knowndimensions of the test strip or housing to the observed features of thetest.

The orientation of the device can be determined from any asymmetry inthe test strip, housing shape, printing or patterns on the housing ortest strip; or may be mandated to the user when capturing the image.

Standard image processing algorithms can be applied to correct for anyrotational misalignment or skew. Rotational misalignment may be mostsimply corrected by examining a region of the image which should have asharp contrasting straight edge (e.g. the edge of a housing) anddetermining the misorientation from horizontal. The whole image may thenbe rotated using one of a number of established algorithms which will beknown to those skilled in the art. For example, rotational by sheer orrotation by area mapping. Rotation by sheer is approximately sixty timesfaster than rotation by area mapping but may cause distortion in theimage.

Correction of images for tilt, perspective, skew etc requires that thedegree of error is either known or estimated. This may be achieved bymeasuring distinct boundaries with reference to the expected geometry ofthe test housing. Alternatively or in addition, inbuilt sensors withinthe device may provide this information. For instance, assuming the testsubstrate is horizontal (e.g. on a desk or bench) the accelerometerswithin a phone can indicate the degree of misorientation of the devicefrom the same plane thus facilitating software correction. Likewisethose accelerometers could be used to prevent image capture if thedevice is not oriented within an acceptable range of angles.

With the bounds of the test strip or housing defined by criteria such ascontrast, the region of interest [22] containing the result can beidentified from the geometric properties of the particular test orhousing.

Image information obtained from close to the boundaries of the teststrip or result window may be discarded as artefacts are most commonlyobserved in these areas.

By summing the values of pixels in columns within the region of interestit is possible to significantly reduce the noise on the data and obtainmore robust results.

When a test strip is contained within a housing there is often apositional error, particularly along the axis of flow. The exactpositions of the test and control lines may therefore not be preciselycontrolled with respect to the edges of the housing.

The positions of the lines can be found by “peak searching” within theregion of interest. A peak will be characterised by having a series ofsuccessive pixels with increasing values. By specifying limits on theexpected position of peaks, minimum “intensity thresholds” for peaks,and peak width (e.g. by defining a number of successive pixels whichmust increase)—it is possible to filter out “noise” or artefacts whichare not the real peaks. Control lines [18] on lateral flow assays willnormally form characteristic strong peaks.

Test lines on lateral flow assays may be found within an expecteddistance from the control line. Depending upon the manufacturing processemployed the line spacing may be tightly controlled. It will be possibleto predict the line position from the overall scale of the image, usingthe known dimensions of the test strip or housing as a dimensionalreference.

The size of test and control lines may be quantified as either the peakheight [27] or peak area [28] (which both may or may not be measuredrelative to some corrected baseline [29]). These values may be useddirectly to compute a measurement of concentration for the test, or maybe subject to further analysis.

Batch to batch, test to test, sample to sample and illuminationvariations may, at least partially be eliminated by measuring therelative size of the test peak compared to the control peak rather thanthe absolute values. For a system using an irrelevant control theresponse, R, may simply be considered as:R=Test Peak/Control Peak.

For a system which does not have an irrelevant control, and wheretherefore the control line intensity falls as the test line intensityincreases, the response may be considered as:R=Test Peak/(Test Peak+Control Peak)

From the measured response an estimate of analyte [19] concentration,may be obtained e.g. by comparing to a known calibration curve, byreferring to a look up table or computation using parameters provided bythe user or determined optically from the test strip, housing orpackaging.

EXAMPLE 1: QUANTIFICATION OF A LATERAL FLOW DEVICE

The standard methods for detection of Legionella bacteria (the causativeagent of Legionnaires' Disease) in water are normally slow andlaboratory based. It has previously been shown that Legionellapneumophila serogroup 1 antigen can be detected in water using a lateralflow immunoassay, which is simple enough to be performed in the field.

The assay is performed by adding a sample of water to the test strip.The water first contacts a woven pad [29] impregnated with chemicals toadjust the pH and other properties of the sample, the sample in thendrawn onto a second pad [30] by capillary action. The second pad isimpregnated with antibody-coated gold nanoparticles (coloured red)specific to Legionella pneumophila serogroup 1. The second pad is incontact with a nitrocellulose membrane which has antibodies bound in twonarrow bands perpendicular to the direction of capillary flow. The firstband of antibodies [4] are specific to Legionella bacteria, whilst thesecond are raised against an irrelevant control (i.e. a material notexpected to be in the sample) bound to some of the gold particles [12].A large absorbent pad [31] in contact with the nitrocellulose wicks thewater away from the nitrocellulose maintaining capillary flow.

On addition of water containing Legionella antigen [19] to the sample,the antigen binds to the gold nanoparticles [12] and then becomessandwiched [6] between the antibody on the test strip and the colouredgold particles [12] forming a pink-to-red coloured line across the test.The irrelevant control particles become bound as a second line [18]across the test which functions as a control.

The antigen level can be quantified by capturing an image [20],identifying the region of interest [22] and processing that image via anumber of steps to yield the relative area of the test line to thecontrol line. By comparison to a known reference curve the approximateconcentration of antigen can be estimated.

Application to Chemical/Biochemical Colorimetric Assays

In contrast to Lateral flow assays where the colour change appears at aspecific location on the test, typically in chemical/biochemical orcolorimetric assays all, of the test strip [23] exposed to the samplewill change colour on exposure to the desired analyte. In some cases asmaller sample pad [24] will change colour whilst the rest of the deviceis left unchanged. Perhaps the most commonly know example of such testsis “pH paper” where the pH of a sample results in a colour change whichindicates the pH of the sample. However such colorimetric indicatortests are used across a whole range of samples for a wide range ofdifferent markets, e.g. water quality testing (parameters including butnot restricted to pH, chlorine, alkalinity, iron, hardness, silica,nitrates, nitrites are all routinely measured using such approaches),medical/clinical diagnostics (parameters including but not restricted toprotein, ketones, glucose and blood in urine), soil testing (forexample, parameters including but not restricted to pH, N/P/Knutrients), and food hygiene and processing (parameters including butnot restricted to the detection of NAD/H NADP/H, quaternary ammoniumdisinfectants and oil quality).

A test strip may contain one [32] or more [33] tests on a single testenabling multiple chemical tests to be performed on a single device, ordifferent test ranges to be covered with a single device.

The test result is normally obtained by visually comparing the result toa reference chart [25], often printed or included on the packaging [34,35].

A camera equipped consumer electronic device [1] may be used to quantifythe results from such assays by capturing the test strip image andprocessing the colour/hue information from the image. In order tocorrect for ambient light variations it may be most easily achieved ifthe reference scale [25] is also captured in the same image. Thesoftware may then identify the correct portions of the image, along withany scale/labelling information [37] and derive the estimatedconcentration in the sample by colour matching the reference scale [25]and the exposed or working area of the test strip [24]. Optionally thesoftware may include a correction for differences in printing or surfacefinishes which are hard to match by eye.

The image processing may be simplified if the test strips and referencescale are placed on contrasting backgrounds, and if any sharpasymmetrical features [38] are included in the packaging or labelling ofthe test and/or reference scale such that correct orientation is moreeasily identified by the software.

The colour hue, or some other measurement of colour, optical density orshade may be made using an image captured on readily available cameras[3], such as those found integrated into mobile phones, tablet PCs,netbooks, laptop computers and other consumer electronic devices [1].The image [20] may be processed by software included within the device[1]. The exact steps and sequence of steps necessary to analyse an imagefrom a particular test may vary, but in general are likely to includesome, or all of the following:

-   -   (1) identify the location and orientation of the test strip [32]        and reference scale [25] in the image.    -   (2) identify the location of the result region(s) [24] within        the test strip.    -   (3) Measure the colour or hue of the region of interest [24].    -   (4) Measure the colour or hue of various points on the reference        scale [25].    -   (5) Correlate the hue of the region of interest to the scale        obtained on the reference scale.

The software may then store, display or distribute this data using otherfunctions and connectivity built into the consumer device. The softwaremay append time stamps, user identities, geographic locations or otheruser defined information to the data for future analysis and qualitycontrol.

The software may upload data to a central database such as a LaboratoryInformation Management System or other data repository. The software, ordatabase may be used to trigger certain actions, such as responding to aproblem identified by an individual measurement or trend, alerting auser or other interested parties to a result or trend or providingcontent (via the web, email, or other communication systems includingoff-line communication) relevant to the test results obtained. Thetargeted information could include marketing, advertising or promotionalmaterial, either now or at some future date based on the outcome ofresults.

The software may integrate with other services on the device or via theinternet such as calendars to provide reminders of regular test patternsas required.

The software may apply correction or filters to an image to removeelectronic or optical noise from the image. Many standard noise filtersare known to those skilled in the art. Simple noise filters may simplyinvolve convoluting two arrays.

The software may control the brightness, contrast, gain and flashsettings of the device during capture in order to achieve an optimalimage for subsequent processing.

The software may discard areas of the image which do not contain usefuldata to facilitate faster processing on the device.

The software may convert a colour image, to a grey scale image, or tosome other form of representation to facilitate faster processing on thedevice.

The software may convert some or all of the image to a black and whiteimage (binary array) to accelerate processing, such as in determiningthe location and edges of the region of interest. Having identified therelevant portions of the image and calculated any necessary rotationalcorrection the software may then revert to some or all of the originalimage file, for more detailed processing.

The software may automatically reject images which are of inadequatequality to yield useful results.

The software may guide the user during image capture to assist the userin capturing a suitable image, e.g. correctly orienting the device,correctly focussing the device, and obtaining adequate illumination. Onepossible solution to simplify the processing, being to display a guideor template overlay showing the outline of the test strip and/or regionof interest. If the image can be processed for suitability in near realtime then the correct orientation may be indicated on the screen andimage capture initiated automatically. One option for this interactivefeedback being the change of colour of the template, outline or guidemarks, for example by changing from red (no suitable image) to green(suitable image), thus avoiding additional ‘clutter’ in the display.Similarly, the software may provide the user with an audio or tactileindication that an image has been acquired, e.g. by playing a simulated“camera shutter sound”, a simple beep or activating an inbuilt vibrationalert within the device.

The software may also provide the user with information about the useand operation of the test, e.g. pre-processing steps, incubation times,etc. The software may even force the user to allow the full incubationtime by taking images before and after testing.

The software may include a countdown-tinier, for timing test durations.

Contrasting colours, e.g. on the test strip housing, and distinct shapesof housing may simplify the image processing. Where there is no housingor the housing is a similar colour to the test strip it may bepreferable to place the test strip against a contrasting backgroundduring image capture.

The software may capture information about for example the form or teststrip being used, its expiry date or batch-to-batch variation insensitivity from text based data printed on the strip or packaging, froma one or two-dimensional bar code [26] on the device. Such data may bestored with the eventual test results. Such data may be capturedsimultaneously with the test image or immediately before or after thetest image. Similar processes may be used to identify physical locations(e.g. with bar code tagged assets) or patients or test users toaccelerate and reduce data entry errors.

The test strip or housing may be located on the image by scanning fromtop to bottom and left to right for an object of approximately the rightproportions. The proportions of the test strip (or housing) willnormally be well defined and highly repeatable, and thus preloaded onthe device. Features or patterns on the housing or test strip can thenbe used to verify the recognition. The reference scale is likely to forma highly repeatable image shape/form for use in image recognition.

The scale of the image can then be estimated by comparing the knowndimensions of the test strip or reference scale to the observed featuresof the test.

The orientation of the device can be determined from any asymmetry inthe test strip, housing shape, printing or patterns [38] on the or teststrip, or the packaging [34,35] or reference scale [25] included withinthe image; or may be mandated to the user when capturing the image.

Standard image processing algorithms can be applied to correct for anyrotational misalignment or skew. Rotational misalignment may be mostsimply corrected by examining a region of the image which should have asharp contrasting straight edge (e.g. the edge of a housing) anddetermining the misorientation from horizontal. The whole image may thenbe rotated using one of a number of established algorithms which will beknown to those skilled in the art. For example, rotational by sheer orrotation by area mapping. Rotation by sheer is approximately sixty timesfaster than rotation by area mapping but may cause distortion in theimage.

With the bounds of the test strip or housing defined by criteria such ascontrast, the region of interest containing the result can be identifiedfrom the geometric properties of the particular test or housing.

Image information obtained from close to the boundaries of the teststrip or result window may be discarded as artefacts are most commonlyobserved in these areas.

Averaging across the region of interest it is possible to significantlyreduce the noise on the data and obtain more robust results. Somemeasurement of error may be obtained by averaging across multiple “subzones” within the region of interest [24].

In order to process the region of interest into one or more numericalvalues which will enable comparison or matching with the reference scaleit may be useful for the software, to convert the raw pixel data intoits red, green and blue components, from both the region of interest andthe reference scale. With very simple colour based tests this may besufficient. Where the test is likely to produce variety of colours orwhere the changes are subtle it may be preferable to first convert thevalue to a scale more directly related to the human perception ofcolour, such as the Munsell System, the CIE or Hunter LAB systems. Asthere is no absolute scale with which to make comparison true conversionto these systems is unlikely to be facile, but by comparing to a systembased on such representation, and by doing likewise with the referencescale [25] in the same image an estimate of where the value falls in therange may be possible.

Whilst described above as testing test “strips” using diffuse reflectedlight the overall approach is applicable to other colorimetric assayswhere those assays may be measuring diffuse reflected light ortransmitted light, and could include vials, test tubes or cuvettescontaining liquids which are themselves coloured, or which induce acolour change in the container/vessel being imaged by the consumerelectronic device [1]. Similarly whilst used in a diffuse reflectancemeasurement the colour of surfaces or materials may be matched to areference chart, for other scientific or testing purposes using the samegeneral approach.

Whilst specific embodiments of the present invention have been describedabove, it will be appreciated that departures from the describedembodiments may still fall within the scope of the present invention.For instance, whilst the present specification describes use with ausually solid substrate it will be appreciated that this approach couldeasily be adapted for measuring liquid samples contained within a vial,cell or other container. Where the path length through the container isfixed, and where it is places against a suitable background (such as awhite piece of paper) the colour in the cell may be observed andcompared to reference samples. Likewise formats such as 96- or 384-wellplates in which numerous experiments are performed in parallel may beanalysed using this sort of approach. Such testing may include assaysfor chemicals (for example testing for free chlorine using the pinkcolour formed on reaction with diethyl-p-phenylene diamine) or animmunoassay (for example the green colour formed in the presence ofhorse radish peroxidase in enzyme linked immunosorbent assays (ELISAs)).

The invention claimed is:
 1. A method of performing an assay, the methodcomprising: generating image data using an image capture device of amobile processing device when an error fails to exceed a predeterminedvalue, where the mobile processing device is configured to generate noless than substantially real-time interactive feedback to a user of themobile processing device to guide repositioning of the image capturedevice relative to a test device prior to generating the image data;evaluating the image data, generated from the image capture deviceviewing at least a portion of the test device, to determine at least oneof a color, a line, and a pattern of the test device post introductionof an analyte; and, using the mobile processing device to automaticallyoutput a test result responsive to evaluating the image data.
 2. Themethod of claim 1, wherein the test result is output to a mobile networkcomprising at least one of a Wi-Fi network and a telecommunicationsnetwork.
 3. The method of claim 1, wherein evaluating the image dataincludes measuring a developed color.
 4. The method of claim 1, whereinevaluating the image data includes comparing a developed color of theimage data to a predetermined color scale, where the predetermined colorscale includes different testing results based upon different colors. 5.The method of claim 1, further comprising inhibiting generating theimage data by the image capture device when the error exceeds thepredetermined value.
 6. The method of claim 1, where the mobileprocessing device is configured to record data for at least one of date,time, batch number, location, and calibration when the image data isgenerated.
 7. The method of claim 5, wherein the test result is outputto a mobile network comprising at least one of a Wi-Fi network and atelecommunications network.
 8. The method of claim 5, wherein evaluatingthe image data includes measuring a developed color.
 9. The method ofclaim 5, wherein evaluating the image data includes comparing adeveloped color of the image data to a predetermined color scale, wherethe predetermined color scale includes different testing results basedupon different colors.
 10. The method of claim 5, where the mobileprocessing device is configured to record data for at least one of date,time, batch number, location, and calibration when the image data isgenerated.